Mechanism for memory reduction in picture-in-picture video generation

ABSTRACT

A mechanism for memory reduction in picture-in-picture video generation is disclosed. A method of embodiments of the invention includes receiving, from a transmitting device, a plurality of video streams at a receiving device coupled to the transmitting device, wherein a first video stream of the plurality of video streams is designated to be displayed as a main video and one or more other video streams of the plurality of video streams are designated to be displayed as one or more sub videos to the main video. The method further includes transforming the one or more other video streams into the one or more sub videos, temporarily holding the one or more sub videos in a compressed frame buffer, and merging, via pixel replacement, the main video and the one or more sub videos into a final video image capable of being displayed on a single screen utilizing a display device, wherein pixel replacement is performed such that the one or more sub videos occupy one or more sections of pixels of screen space pixels occupied by the main video.

FIELD

Embodiments of the invention generally relate to the field of electronicnetworks and, more particularly, to perform memory reduction inpicture-in-picture video generation.

BACKGROUND

In the operation of a system that utilizes multiple data streams, suchas multiple media data streams for display. The data may include dataprotected by High-bandwidth Digital Content Protection (HDCP) data,which is referred to herein as HDCP data. Communicating multiple mediadata streams may include a flow of content between a transmittingauthority (e.g., cable television or satellite companies) and areceiving device (e.g., a television (TV)) via a transmission device(e.g., cable/satellite signal transmission device) through aHigh-Definition Multimedia Interface (HDMI).

Picture-in-picture (PiP) is a feature of some video transmitters andreceivers in which one programming channel is displayed on a full screenof a receiving device (e.g., television) at the same time as one or moreother channels are displayed in inset windows of the full displayscreen. This technique allows receiving device viewers to see multiplechannels in a single screen by mixing multiple video streams. However,since PiP requires a great deal of memory, it is primarily used for andimplemented on general-purpose processor-based platforms that employrelatively large amounts of memory and are not suitable for smallerplatforms, such as an Application-Specific Integrated Circuit(ASIC)-based platform. ASIC refers to integrated circuit that is notused for general purpose; rather, it is customized for a particular use(e.g., customized and particular for use with handheld devices, smartphones, etc.). Given that an ASIC-based platform is customized for aparticular use, it does not contain memory large enough to accommodate aconventional implementation of PIP.

FIG. 1 illustrates a conventional mechanism for generatingpicture-in-picture video from multiple video streams. As illustrated,two incoming videos or video streams 102, 104 enter PiP processing area106 as one video stream 102 is selected as main video 108 by the viewer,while the other video stream 2 104 is selected to be shown as sub video110. Video stream 102 passes through main channel selection 112 andemerges main video 108 without any changes to it, such as with regard toits size, etc. Video stream 104, however, passes through sub channelselection 114 and then on to down sampling 116 where it is down-sampledand emerges as sub video 110. Down-sampling 116 refers to reduction inor sampling down of the image size of video stream 104 by a certainamount or ratio resulting in generation of sub video 110 which, asillustrated, is much smaller than the original video stream 104. Bothvideos 108, 110 are then put through the conventional video mixingprocess 118 which merges the two images 108, 110 to be displayed as mainvideo 108 and sub video 110 on a single display screen, as illustrated.

FIG. 2 illustrates a conventional picture-in-picture implementation 200designed to operate on a processor-based platform. Video or videostreams 202, 204 enter chip 214 through video interfaces 206, 208 (e.g.,HDMI), respectively, on to processor 210. Processor 210 receives andreads the original videos 202, 204 from their channels and stores themin memory 216. Processor 210 then perform down-sampling algorithm andstores the results, including main video 218 and down-sampled sub video220, back in memory 216. Main video 218 and sub video 220 are thenmerged together by processor 210 to generate a single final image 222that contains both the main video 218 and sub video 220. As illustrated,this conventional implementation 200 requires a rather large memory 216to store at least one video image, main video 218, and in many casesmultiple video images 218, 220. This PiP implementation 200 only workswith a large-capacity external memory device 216, resulting in highmanufacturing cost for television systems having a PiP feature andmaking it unsuitable for smaller devices, such as cellular phones.

SUMMARY

A mechanism for reduction of memory in picture-in-picture videogeneration is disclosed.

A method of embodiments of the invention includes receiving, from atransmitting device, a plurality of video streams at a receiving devicecoupled to the transmitting device, wherein a first video stream of theplurality of video streams is designated to be displayed as a main videoand one or more other video streams of the plurality of video streamsare designated to be displayed as one or more sub videos to the mainvideo. The method further includes transforming the one or more othervideo streams into the one or more sub videos, temporarily holding theone or more sub videos in a compressed frame buffer, and merging, viapixel replacement, the main video and the one or more sub videos into afinal video image capable of being displayed on a single screenutilizing a display device, wherein pixel replacement is performed suchthat the one or more sub videos occupy one or more sections of pixels ofscreen space pixels occupied by the main video.

A system of embodiments of the invention includes a data processingdevice having a storage medium and a processor coupled with the storagemedium, the data processing device further having a picture-in-picturevideo generation mechanism. The picture-in-picture video generationmechanism to receive, from a transmitting device, a plurality of videostreams at a receiving device coupled to the transmitting device,wherein a first video stream of the plurality of video streams isdesignated to be displayed as a main video and one or more other videostreams of the plurality of video streams are designated to be displayedas one or more sub videos to the main video. The picture-in-picturevideo generation mechanism is further to transform the one or more othervideo streams into the one or more sub videos, temporarily hold the oneor more sub videos in a compressed frame buffer, and merge, via pixelreplacement, the main video and the one or more sub videos into a finalvideo image capable of being displayed on a single screen utilizing adisplay device, wherein pixel replacement is performed such that the oneor more sub videos occupy one or more sections of pixels of screen spacepixels occupied by the main video.

An apparatus of embodiments of the invention includes a data processingdevice having a storage medium and a processor coupled with the storagemedium, the processor to receive, from a transmitting device, aplurality of video streams at a receiving device coupled to thetransmitting device, wherein a first video stream of the plurality ofvideo streams is designated to be displayed as a main video and one ormore other video streams of the plurality of video streams aredesignated to be displayed as one or more sub videos to the main video.The processor is further to transform the one or more other videostreams into the one or more sub videos, temporarily hold the one ormore sub videos in a compressed frame buffer, and merge, via pixelreplacement, the main video and the one or more sub videos into a finalvideo image capable of being displayed on a single screen utilizing adisplay device, wherein pixel replacement is performed such that the oneor more sub videos occupy one or more sections of pixels of screen spacepixels occupied by the main video.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the invention are illustrated by way of example, and notby way of limitation, in the figures of the accompanying drawings inwhich like reference numerals refer to similar elements:

FIG. 1 illustrates a conventional mechanism for generatingpicture-in-picture video from multiple video streams;

FIG. 2 illustrates a conventional picture-in-picture implementationdesigned to operate on a processor-based platform;

FIG. 3 illustrates a picture-in-picture video generation systemaccording to one embodiment of the invention;

FIG. 4 illustrates pixel replacement of a picture-in-picture videogeneration system according to one embodiment of the invention;

FIG. 5 illustrates a method for picture-in-picture video generationaccording to one embodiment of the invention; and

FIG. 6 is an illustration a network computer device employingpicture-in-picture video generation according to one embodiment of theinvention.

DETAILED DESCRIPTION

A mechanism for memory reduction in picture-in-picture video generationis disclosed. A method of embodiments of the invention includesreceiving, from a transmitting device, a plurality of video streams at areceiving device coupled to the transmitting device, wherein a firstvideo stream of the plurality of video streams is designated to bedisplayed as a main video and one or more other video streams of theplurality of video streams are designated to be displayed as one or moresub videos to the main video. The method further includes transformingthe one or more other video streams into the one or more sub videos,temporarily holding the one or more sub videos in a compressed framebuffer, and merging, via pixel replacement, the main video and the oneor more sub videos into a final video image capable of being displayedon a single screen utilizing a display device, wherein pixel replacementis performed such that the one or more sub videos occupy one or moresections of pixels of screen space pixels occupied by the main video.Further details are discussed throughout this document.

As used herein, “network” or “communication network” mean aninterconnection network to deliver digital media content (includingmusic, audio/video, gaming, photos, and others) between devices usingany number of technologies, such as Serial Advanced TechnologyAttachment (SATA), Frame Information Structure (FIS), etc. Anentertainment network may include a personal entertainment network, suchas a network in a household, a network in a business setting, or anyother network of devices and/or components. A network includes a LocalArea Network (LAN), Wide Area Network (WAN), Metropolitan Area Network(MAN), intranet, the Internet, etc. In a network, certain networkdevices may be a source of media content, such as a digital televisiontuner, cable set-top box, handheld device (e.g., personal deviceassistant (PDA)), video storage server, and other source device. Otherdevices may display or use media content, such as a digital television,home theater system, audio system, gaming system, and other devices.Further, certain devices may be intended to store or transfer mediacontent, such as video and audio storage servers. Certain devices mayperform multiple media functions, such as cable set-top box can serve asa receiver device (receiving information from a cable headend) as wellas a transmitter device (transmitting information to a TV) and viceversa. Network devices may be co-located on a single local area networkor span over multiple network segments, such as through tunnelingbetween local area networks. A network may also include multiple dataencoding and encryption processes as well as identify verificationprocesses, such as unique signature verification and uniqueidentification (ID) comparison. Moreover, an interconnection network mayinclude HDMIs. HDMI refers to an audio-video interface for transmittinguncompressed digital data, and represents a digital alternative toconventional analog standards, such as coaxial cable, radio frequency(RF), component video, etc. HDMI is commonly used to connection variousdevices, such as set-top boxes, digital video disk (DVD) players, gameconsoles, computer systems, etc., with televisions, computer monitors,and other display devices. For example, an HDMI can be used to connect atransmitting device to a receiving device and further to otherintermediate and/or peripheral devices, such as a separate displaydevice, etc.

FIG. 3 illustrates a picture-in-picture video generation system 300according to one embodiment of the invention. In one embodiment, PiPvideo generation system 300 employs a PiP video generation mechanism ata microprocessor or chip 306 to provide a novel combination of real-timeframe compression, at compression unit 312, and decompression, atdecompression unit 314, using a compressed frame buffer 318 andon-the-fly pixel replacement process, at pixel replacement unit ormechanism 322, to reduce memory requirements and eliminate theconventional requirements for having large amounts of memory, such asframe memory, for performing PiP video generation. Video stream 302 andvideo stream 304 are selected by a user to be merged into and displayedas a single video image 328 on a display device at the end of the PiPvideo generation process 300. In the illustrated embodiment, videostream 302 is selected and designated to serve as main video 326 (alsoreferred to as primary video), while video stream 304 is selected anddesignated to serve as sub video 320 (also referred to as secondaryvideo). Two video streams 302, 304 and their corresponding main video326 and sub video 320 are merely used as examples for brevity andclarity and it is contemplated that the number of inputs are not limitedto merely two video streams. For example, if there one video stream thatis designated and displayed as a main video, any number of other videostreams can be designated and displayed as sub videos. Throughout thisdocument, two video streams designated as a main video and a sub videoare illustrated and discussed, as aforementioned, as examples forbrevity and clarity. Additionally, in reference to this invention, terms“main” and “sub” are synonymous to “primary” and “secondary”,respectively. For example, “main video” is also referred to as “primaryvideo”, while “sub video” is also referred to as “secondary video”.Similarly, it is contemplated that several ratios, components, etc., aremerely used as examples for brevity and simplicity (e.g., a ratio may be5:1 or 10:1, etc.; a port may include an HDMI or a non-HDMI port, etc.).

Given that video steam 302 is designated to be displayed as main video326 and thus does not require any augmentation (such as down-sampling,compression, decompression, etc.), it is taken directly for pixelreplacement via pixel replacement mechanism 322 through port 1 324.Video steam 304, on the other hand, starts with going through a processof down-sampling 308. In down-sampling 308, video stream 304 isdown-sampled to a reduced size based on a defined ratio (such as a ratioof 5:1, i.e., 5 lines are reduced to 1 line). It is contemplated thatany down-sampling ratio can be defined for down-sampling as necessitatedor desired. The down-sampled version of video stream 304 is then passedthrough line buffer 310 (e.g., line by line or several lines at a timeas necessitated or desired) and further through a compression unit 312for compression using, for example, an image compression algorithm.

The down-sampled and compressed version of video stream 304, now subvideo 320, is sent to and temporarily held in compressed frame buffer318. Any number of lines (including a minimum and/or minimum number oflines, rows, sub-frames, etc.) and a variable size or length of bitstreams (e.g., 25 Kbyte, 50 Kbyte, 100 Kbyte, etc.) of sub video 320 maybe sent to and stored in compressed frame buffer 318. Compressed framebuffer 318, in one embodiment, receives and temporarily stores anynumber of lines or sub-frames of sub video 320 according to any numberof video compression and decompression techniques. In anotherembodiment, the compression and decompression processes are row-based(as opposed, for example, to frame-based). A row includes a set of linesthat fit and are compatible with the transform algorithm that is used inthe processes of compression at compression unit 312 and decompressionat decompression unit 314. Sub video 320 is then sent (e.g., line byline, row by row, frame by frame, etc.) from compressed frame buffer 318to a decompression unit 314 for decompression.

In one embodiment, another line buffer, line buffer 316, is designatedto serve as transit or pit stop to temporarily store and transportlines, rows or frames of sub video 320 to a pixel replacement mechanism322 for pixel replacement. In one embodiment, pixel replacement isperformed to merge and synchronize sub video 320 with main video 326,while line buffer 316 operates as a buffer to provide pixel data of subvideo 320 to be gradually overlaid in or imposed on a selected portionof main video 326 so that the merging of sub video 320 with main video326 is performed accurately and in a synchronized manner. The process ofpixel replacement is performed to merge main video 326 and sub video 320such that main video 326 occupies the entire screen 328, while sub video320 occupies a section of the screen 328 while being imposed on mainvideo 326. The full and final image 328 is displayed to the user using adisplaying device of or coupled to a receiving device, such as TV.

One of the advantages of the aforementioned technique is simply using acompressed frame buffer 318 and a couple of line buffers 310, 316 toimplement and perform PiP video generation with all the necessary logicand memory on a single microprocessor chip 306. This allows for notablyreducing manufacturing cost for PiP video controller chip bysignificantly reducing the needed on-chip memory area and the number ofpin counts for interfacing with off-chip memory.

FIG. 4 illustrates pixel replacement unit or mechanism 322 of apicture-in-picture video generation system 300 according to oneembodiment of the invention. In one embodiment, pixel replacement isperformed to merge main video 326 and sub video 320 into a single videoimage. Let us supposed, P 402 is a pixel that is incoming to port 1(such as port 324 of FIG. 3) of pixel replacement 322. The variable (x,y) 404 indicates the distance from the top left corner of main video326, while variable (x0, y0) 406 indicates the top left coordinates ofsub video 320 and variable (x1, y1) 408 indicates the bottom rightcoordinates of sub video 320. The process of pixel replacement, viapixel replacement mechanism 322, replaces pixels of main video 326(through port 1) with pixels of sub video 320 through port 2 (such asport 326 of FIG. 3) as pixel P402 satisfies the following criteria: x islarger than x0 and smaller than x1, while y is larger than y0 andsmaller than y1. To prepare sub video-related data (e.g., video imagelines or rows) on line buffer 2 (such as line buffer 316 of FIG. 3) tobe ready for an on-the-fly pixel replacement, while decompression isperformed in advance by predicting the above condition matching. Thison-the-fly replacement technique eliminates the conventional largememory requirement for storing main video 326.

In one embodiment, pixel replacement extracts pixels of main video 326per color depth, and performs color conversion of sub video 320 or mainvideo 326, as necessitated or desired, and further performsdown-sampling of sub video 320 per resolution. For example, a certainamount of main video pixels belonging to main video 326 (form thesection represented between variables (x0, y0) 406 and (x1, y1) 408, isreplaced with sub video pixels of sub video 320, as illustrated betweenvariables (x0, y0) 406 and (x1, y1) 408. Pixel replacement may furtherinclude color conversion or adjustment, such as color depth of sub videopixels is adjusted or formatted according to the color-depth of the restof the main video pixels of main video 326.

FIG. 5 illustrates a method 500 for picture-in-picture video generationaccording to one embodiment of the invention. Method 500 may beperformed by processing logic that may comprise hardware (e.g.,circuitry, dedicated logic, programmable logic, microcode, etc.),software (such as instructions run on a processing device), or acombination thereof, such as firmware or functional circuitry withinhardware devices. In one embodiment, method 500 is performed by PiPvideo generation system 300 of FIG. 3.

Method 500 starts at block 505 with multiple videos stream, such as twovideos A and B, being received at a processor that is used in PiP videogeneration. It is contemplated that any number of video stream may bechosen by the user for merging and displaying and that two video streamA and B are merely used as an example for brevity and simplicity. At thetime of selection, the user delegates or chooses video stream A as mainvideo and video stream B. Once received, video stream A (main video) istransmitted for pixel replacement to a pixel replacement processing unitor mechanism at block 510. Video B (sub video) is down-sampled by adown-sampling unit, and the down-sampled video stream B is transmittedto a compression unit for compression at block 515. The down-sampledvideo stream B is compressed and then transmitted (e.g., line by line orrow by row, etc.) to a compressed frame buffer at block 520.

In one embodiment, the compressed frame buffer is used to temporarilyhold the compressed down-sampled video stream B and then, transfer thecompressed down-sampled video stream B to a decompression unit fordecompression at block 525. The compressed down-sampled video stream maybe set to be received and transmitted in any sequence, size, andquantity. At block 530, the compressed down-sampled video stream isreceived from the compressed frame buffer (e.g., line by line, row byrow, or frame by frame, etc.) and decompressed and transmitted, as subvideo B, to the pixel replacement mechanism for pixel replacement. Thistransmission (e.g., line by line, frame by frame, etc.) to the pixelreplacement mechanism/unit is performed gradually and in synchronizationso that a section of pixels of the main video A is superimposed by thesub video B. At block 535, video A and the sub video are merged into asingle video image together during the pixel replacement process. Themerging of the videos A and B is performed such that sub video B isimposed on and occupies a section of the pixel space of main video A. Atblock 540, the merged video (having video A as main video and video B assub video) is displayed as a single video image on a display device onor coupled with the receiver device (e.g., TV).

FIG. 6 illustrates components of a network computer device 605 employingpicture-in-picture video generation system according to one embodimentof the invention. In this illustration, a network device 605 may be anydevice in a network, including, but not limited to, a television, acable set-top box, a radio, a DVD (digital video disk) player, a CD(compact disk) player, a smart phone, a storage unit, a game console, orother media device. In some embodiments, the network device 605 includesa network unit 610 to provide network functions. The network functionsinclude, but are not limited to, the generation, transfer, storage, andreception of media content streams. The network unit 610 may beimplemented as a single system on a chip (SoC) or as multiplecomponents.

In some embodiments, the network unit 610 includes a processor 615 forthe processing of data. The processing of data may include thegeneration of media data streams, the manipulation of media data streamsin transfer or storage, and the decrypting and decoding of media datastreams for usage. The processing data further includes, in oneembodiment, a PiP processor 690 to perform embodiments of the presentinvention, including PiP video generation as described with reference toFIGS. 3-5 and throughout this document. In one embodiment, PiP videogeneration processing is performed on a separate chip or by having thechip integrated into SoC. Further, PiP processor 690 can be placedeither before or after processor 615 as indicated by the solid anddotted arrows between the two processors 615, 690 and to video output665. PiP processor 690 is further configured to receive any number ofvideo inputs 660 from any number of sources. The network device may alsoinclude main memory 620 to support network operations, such as RAM(random access memory) including DRAM (dynamic random access memory),SRAM (static random access memory), etc., or other similar memory andflash memory 625 or other nonvolatile memory for storing certainelements as well as information and instructions to be executed by theprocessors 615, 690.

Memory 620 also may be used for storing data for data streams. DRAM mayrequire refreshing of memory contents, while static random access memorySRAM may not require refreshing contents, but at increased cost. DRAMmemory may include synchronous dynamic random access memory (SDRAM),which includes a clock signal to control signals, and extended data-outdynamic random access memory (EDO DRAM). In some embodiments, memory ofthe system may certain registers or other special purpose memory. Thenetwork device 605 also may comprise a read only memory (ROM) or otherstatic storage device for storing static information and instructionsfor the processors 615, 690.

The network device 605 may also include a transmitter 630 and/or areceiver 640 for transmission of data on the network or the reception ofdata from the network, respectively, via one or more network interfaces655. The transmitter 630 or receiver 640 may be connected to a wiredtransmission cable, including, for example, an Ethernet cable 650, acoaxial cable, or to a wireless unit. The transmitter 630 or receiver640 may be coupled with one or more lines, such as lines 635 for datatransmission and lines 645 for data reception, to the network unit 610for data transfer and control signals. Additional connections may alsobe present. The network device 605 also may include numerous componentsfor media operation of the device, which are not illustrated here.

The device 605 may also be coupled, via an interconnect, to a display orpresentation device. In some embodiments, the display may include aliquid crystal display (LCD), a plasma display, a cathode ray tube (CRT)display, or any other display technology, for displaying information orcontent to an end user. In some embodiments, the display may be utilizedto display television programming and other video content, etc. In someenvironments, the display may include a touch-screen that is alsoutilized as at least a part of an input device. In some environments,the display may be or may include an audio device, such as a speaker forproviding audio information, including the audio portion of a televisionprogram. An input device may be coupled to the interconnect forcommunicating information and/or command selections to the processors615, 690. In various implementations, the input device may be akeyboard, a keypad, a touch screen and stylus, a voice activated system,or other input device, or combinations of such devices. Another type ofuser input device that may be included is a cursor control device, suchas a mouse, a trackball, or cursor direction keys for communicatingdirection information and command selections to the one or moreprocessors 615, 690 and for controlling cursor movement on the display.

In some embodiments the device 605 includes one or more ports for thereception or transmission of data. Data that may be received ortransmitted may include video data or audio-video data, such as HDMI andHDMI-m data, and may be encrypted for transmission, such as HDCPencrypted data. In some embodiments, the device 605 includes one or moreports for the transmission and/or reception of data for the transfer ofcontent data and one or more ports for the transmission and/or receptionof control data, such as command data. The command data may include oneor more messages regarding a change of mode of data transmission, andmay include acknowledgements regarding the change of mode of datatransmission. In addition, the device 605 may include a USB (UniversalSerial Bus).

The device 605 may further include one or more antennas for thereception of data via radio signals. The device 605 may also comprise apower device or system, which may comprise a power supply, a battery, asolar cell, a fuel cell, or other system or device for providing orgenerating power. The power provided by the power device or system maybe distributed as required to elements of the device 605.

In the description above, for the purposes of explanation, numerousspecific details are set forth in order to provide a thoroughunderstanding of the present invention. It will be apparent, however, toone skilled in the art that the present invention may be practicedwithout some of these specific details. In other instances, well-knownstructures and devices are shown in block diagram form. There may beintermediate structure between illustrated components. The componentsdescribed or illustrated herein may have additional inputs or outputswhich are not illustrated or described.

The present invention may include various processes. The processes ofthe present invention may be performed by hardware components or may beembodied in computer-readable instructions, which may be used to cause ageneral purpose or special purpose processor or logic circuitsprogrammed with the instructions to perform the processes.Alternatively, the processes may be performed by a combination ofhardware and software.

Many of the methods are described in their most basic form, butprocesses can be added to or deleted from any of the methods andinformation can be added or subtracted from any of the describedmessages without departing from the basic scope of the presentinvention. It will be apparent to those skilled in the art that manyfurther modifications and adaptations can be made. The particularembodiments are not provided to limit the invention but to illustrateit. The scope of the embodiments of the present invention is not to bedetermined by the specific examples provided above but only by theclaims below.

If it is said that an element “A” is coupled to or with element “B,”element A may be directly coupled to element B or be indirectly coupledthrough, for example, element C. When the specification or claims statethat a component, feature, structure, process, or characteristic A“causes” a component, feature, structure, process, or characteristic B,it means that “A” is at least a partial cause of “B” but that there mayalso be at least one other component, feature, structure, process, orcharacteristic that assists in causing “B.” If the specificationindicates that a component, feature, structure, process, orcharacteristic “may”, “might”, or “could” be included, that particularcomponent, feature, structure, process, or characteristic is notrequired to be included. If the specification or claim refers to “a” or“an” element, this does not mean there is only one of the describedelements.

An embodiment is an implementation or example of the present invention.Reference in the specification to “an embodiment,” “one embodiment,”“some embodiments,” or “other embodiments” means that a particularfeature, structure, or characteristic described in connection with theembodiments is included in at least some embodiments, but notnecessarily all embodiments. The various appearances of “an embodiment,”“one embodiment,” or “some embodiments” are not necessarily allreferring to the same embodiments. It should be appreciated that in theforegoing description of exemplary embodiments of the present invention,various features are sometimes grouped together in a single embodiment,figure, or description thereof for the purpose of streamlining thedisclosure and aiding in the understanding of one or more of the variousinventive aspects. This method of disclosure, however, is not to beinterpreted as reflecting an intention that the claimed inventionrequires more features than are expressly recited in each claim. Rather,as the following claims reflect, inventive aspects lie in less than allfeatures of a single foregoing disclosed embodiment. Thus, the claimsare hereby expressly incorporated into this description, with each claimstanding on its own as a separate embodiment of this invention.

1. A method comprising: receiving, from a transmitting device, aplurality of video streams at a receiving device coupled to thetransmitting device, wherein a first video stream of the plurality ofvideo streams is designated to be displayed as a main video and one ormore other video streams of the plurality of video streams aredesignated to be displayed as one or more sub videos to the main video;transforming the one or more other video streams into the one or moresub videos; temporarily holding the one or more sub videos in acompressed frame buffer; and merging, via pixel replacement, the mainvideo and the one or more sub videos into a final video image capable ofbeing displayed on a single screen utilizing a display device, whereinpixel replacement is performed such that the one or more sub videosoccupy one or more sections of pixels of screen space pixels occupied bythe main video.
 2. The method of claim 1, wherein transforming comprisesdown-sampling the one or more other video streams according to a defineddown-sampling ratio.
 3. The method of claim 1, wherein transformingfurther comprises: transporting the one or more down-sampled videos to acompressor via a first line buffer; and compressing the one or moredown-sampled videos.
 4. The method of claim 1, wherein transformingfurther comprises transporting the one or more compressed down-sampledvideos as the one or more sub videos into the compressed frame buffer.5. The method of claim 1, wherein transforming further comprises:decompressing the one or more compressed down-sampled videos; andtransporting the one or more decompressed down-sampled videos as the oneor more sub videos to a pixel transformation unit via a second linebuffer.
 6. The method of claim 1, further comprising transporting thefirst video as the main video directly to the pixel replacement unit. 7.The method of claim 1, wherein pixel replacement further comprises oneor more of extracting pixels per color depth, performing colorconversion, and down-sampling per resolution of the one or more othervideo streams.
 8. The method of claim 1, wherein occupying the sectioncomprises pixel replacing main video pixels of the section with subvideo pixels, wherein pixel replacing further includes color adjustingthe sub video pixels following a color depth formatting of the mainvideo pixels of the main video.
 9. The method of claim 1, furthercomprising displaying the final video image on a display screen of thedisplay device.
 10. A system comprising: a data processing device havinga storage medium and a processor coupled with the storage medium, thedata processing device further having a picture-in-picture (PiP) videogeneration mechanism; and the PiP video generation mechanism to:receive, from a transmitting device, a plurality of video streams at areceiving device coupled to the transmitting device, wherein a firstvideo stream of the plurality of video streams is designated to bedisplayed as a main video and one or more other video streams of theplurality of video streams are designated to be displayed as one or moresub videos to the main video, transform the one or more other videostreams into the one or more sub videos, temporarily hold the one ormore sub videos in a compressed frame buffer, and merge, via pixelreplacement, the main video and the one or more sub videos into a finalvideo image capable of being displayed on a single screen utilizing adisplay device, wherein pixel replacement is performed such that the oneor more sub videos occupy one or more sections of pixels of screen spacepixels occupied by the main video.
 11. The system of claim 10, whereintransforming comprises down-sampling the one or more other video streamsaccording to a defined down-sampling ratio.
 12. The system of claim 10,wherein transforming further comprises: transporting the one or moredown-sampled videos to a compressor via a first line buffer; andcompressing the one or more down-sampled videos.
 13. The system of claim10, wherein transforming further comprises transporting the one or morecompressed down-sampled videos as the one or more sub videos into thecompressed frame buffer.
 14. The system of claim 10, whereintransforming further comprises: decompressing the one or more compresseddown-sampled videos; and transporting the one or more decompresseddown-sampled videos as the one or more sub videos to a pixeltransformation unit via a second line buffer.
 15. The system of claim10, wherein the PiP video generation mechanism is further totransporting the first video as the main video directly to the pixelreplacement unit.
 16. An apparatus comprising a data processing devicehaving a storage medium and a processor coupled with the storage medium,the processor to: receive, from a transmitting device, a plurality ofvideo streams at a receiving device coupled to the transmitting device,wherein a first video stream of the plurality of video streams isdesignated to be displayed as a main video and one or more other videostreams of the plurality of video streams are designated to be displayedas one or more sub videos to the main video; transform the one or moreother video streams into the one or more sub videos; temporarily holdthe one or more sub videos in a compressed frame buffer; and merge, viapixel replacement, the main video and the one or more sub videos into afinal video image capable of being displayed on a single screenutilizing a display device, wherein pixel replacement is performed suchthat the one or more sub videos occupy one or more sections of pixels ofscreen space pixels occupied by the main video.
 17. The apparatus ofclaim 16, wherein transforming comprises down-sampling the one or moreother video streams according to a defined down-sampling ratio.
 18. Theapparatus of claim 16, wherein transforming further comprises:transporting the one or more down-sampled videos to a compressor via afirst line buffer; and compressing the one or more down-sampled videos.19. The apparatus of claim 16, wherein transforming further comprisestransporting the one or more compressed down-sampled videos as the oneor more sub videos into the compressed frame buffer.
 20. The apparatusof claim 16, wherein transforming further comprises: decompressing theone or more compressed down-sampled videos; and transporting the one ormore decompressed down-sampled videos as the one or more sub videos to apixel transformation unit via a second line buffer.